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CURVE FITTING VIA THE CRITERION, OF LEAST SQUARES* 



, • ' 1. INTRODUCTION 

In'many instances, we \*ish to fro* able To predict the 
outcome of cer^arn phenomena. For example,* we ma> \>Jnt " 
to "knpw which^ students in a, graduat 1 ng higfi-s'chool cl'ass 
will do well in their first year 6f college/' 

One way to get a measure, or at least an indication 
would be to observe the high-school grades in-Engfish of 
> 20 or so students who have gone to co liege*. If we match 
the students 1 English grades with # their grade ^point 
average after one semester, we would be able, to see if 
good grades in English matched with high grade point 
averages. * 0 

If the "correlation" is high^ then, we might wish to 

assert that students who^do well in high-school- English 

do well in college. There may b$ exceptions of course. 

W& may want to look at other indicators (e.g., math 

■ grades} but., the pbint.is*, we ; wish to look at two or 

more statistics on the same individual, and we dre 

ihteresVed to know how these statistics relate-. » ' 

* * 

Ideas of the sort alluded to above are" the' subject 

of this module. 



_ * ' 2. SC/VTTER DIAGRAMS 

* .1 . * 

.Many statistical problems are concerned with more 

than a- single characteristic of an individual . For 

instance, the weight and height- Qf a number of people' 

couy be recorded so tfiat an examination of .the relation* 

$hip3a£we4yw.the two measurements could be* made. As a 

"further example, consider how the length of a chopper rod 

relates to its temperature. 



TABUE 1 



Temperature 


Length 


■ (° C) 


(mm) 






» x ♦ 


y 




zqp. i , 


2461 . 16 


28.2. 


2461.49 


38 . 5 . . ' 


, * 2461.88 " 


44.6 


2462.10 


57.4 ' 


. 2462.62 


66.2 


2462.93 


78.1 


2463.38" 







When we draw a. scatter diagram, letting the horizontal 
axis be the scale for the temperature and the vertical 
axis the scale for the length, :>e note that the plotted 
points lie very close to a straight line 0 . Jjt is, therefore, 
reasonable to make 'a quick and accurate estimate of the 
length* of the rod for any temperature between 20.1° and 




• 63.2 ■ 
Temperature (° C) 



Figure 1. * 



78.1°.* - for example, if the temperature was' 63.2° tKe 

dotted lines ioi Figure 1 indicate that the corresponding 

point on the line gives a length of approximately^ 2462". 9 mm 

* \ — .- " 

^ej: us" explore another example that giv.es a us\a scatter 

diagram where the-points arc more scattered. * Table 2 / 

'gives us- the weight in grams, x, and the length of the 

right. hind foot' in millimeters, y, of" a sample of 14 adult 

field mice,' m ^ «. 

TABLE 2 ' " 



t 



Weight (g) 

X 




Length (mm) 

y 


22.3 




m. 23.0 


16.0 




22.6 


18.8 




23.2 


18.2 


\ 


1 • 22.5 


" 16*. 0 




22.2* 


20. A 




23.3 . 


t7.9 




22.8 


19. A ' 




\ 22.4 


^16.9 




\ 21.8 


• 17.6 




\ 22. A 


16.5 » 




\ 22. A 


. 18. 8 




21.5 


17.2 


i 


21^ # 


20. A 




23.3 









•The point in Figure 2 that is circled indicatives where 
two points of the data coincide. The points here are much 
more scattered than those of the previous set. It would 
be* extremely cfif f* icul 1 1 to determine -which strptgh^t .line 
J>est fits this set of points..* In fact," if a number of 
people were to attempt to fit a line to these points, there 
is little doubt, that each person would come up with a 
different line. What we need is'. a mathematical method « 
for determining the line that comes "closest" to all of 
. the points . 
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*We are not «in a position to speculate about values outside of 
this range. • 
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Figure 2. 
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THE LINE OF REGRESSION 



The criterion traditionally used* to.flefine a 
'.'best" fit dates back to the nineteenth ceniury French 
mathematician Adfien Legendre.' It is called tho 
criterion, or method, of least squares* This criterion 
requires the line of regression which we fit to our* 
data to minimize the sum of the squares of the vertical 
deviations ( distances ) from the points ' to the lvt\e . 
*In other words, the method requires the sum of tJie . 
squares of the distances represented by the so'lid line 
segments of Figure 3 to be as; .small as possible. - 

From the figure, we ^ed that the actual grade 
received for a student who studied 11 hours was 79. 
Reading from the line of regression we predict a grade, 
of about 71 . , 

3, • ' . 




f Hours Studied 

Figure 3. Line of regression fittejd ft> data on hours studied 
and examination grades. — , 

• V * 



Observe *that any ,line can -be expressed: 



(1) 



y = bx + c 



(2) 



x = b • y + c • , 



where the b's represent the slope of the^.Vine and *he ,c's * 

#,are inteYpreted as the intercept of the axis. 
* ... 

If we consider Equation (1), knowing the values* of 

b and c will allow us to compare the actuaT values in the : 

y column with bx + c. We take the difference in each case 

and. square the result. * Consider the values of x and y in 

Table - s 



A, , 



:i0 



TABLE 3 



X 

T — — 


y 




bx ■ + c 


[Difference] 




23 

30 


30 


b25 + c ' 


[30 - 


(25b + c)] 2 






b30 + c 


[46 - 


(30b + e)'] 2 


50 


^ 51 


b50 + 9 i 


[51 - 


('50b + c)] 2 




' 20 ' 


2B ■ , 


1 tf20 + c 


< [28 - 


(20b + c)) 2 




70 


48 


> b70 + c 


F48 - 


( 7 fih 4- Ml 




>80 


88,: 

* * 


b80 + c 


[88 - 


(80b + c)] 2 




. 91 


75 


b91 + -t 
• 


[•75 - 


(91b* -b c)L 2 


/ 


• 46 


* 

52 


b46 + c 


[52 - 


(46b + cj] 2 




35 


'35 


b35 + c * 


[35 - 


(35b + c)] « 




25 


28 


b25 + c , 


* .[28 - 


(25b + c)] 2 4 




80 * 


95'" 


b80 + t 

r 


[95* - 

i 


(80b +*c)] 2 





We add up all .-(jf thesx? squared differences.. It must/ 
tlyen be ^determ^ned what values of b' and c'rfiust be used! * 
.in-order, t'o have a line -such that the Sum *f the vertical 
distances from the line to the* dat-a points is at a minimum. 

The Problem: Find the values oP?b Shd fc c such' that 6 
the sum indicated below is a minimum. 



(30-25b-c) 2 + (46-30b-c) 2 + (51-5oVc) 2 + (28--20b-c) 2 
+ (48-70b-c) 2 ^ (88-80b-c) 2 ' + (75-9lVc) 2 + (52-46b-£ 
+ (35-35b-c) 2 +'* (28-25b-c) 2 + (95 -80b.-c) 2 ^ 



The symbol sigma can be* emjjjjhoyed on both sides, of • 
the equa*iop^bove (i.e., ZD 2 = (y. -bx r c) 2 j Since 
£D * is a function of b and t c we 'can write. 



= f(b f c)'-" I (y/bx.Vc). 

i = l 1 1 



To find our desired minimum we find the partial 
derivatives wi|h respect to band c and set the results 
equal to zero. We obtain two equations in*two unknowns • ' 



which we solve simultaneously. This gives- us the 
desired values of b and c and thus our line of best fit 
(the line of regression). 

Trace through the actual development given below. 

f(b,c) = I (y -bx.-c) 2 
i = l 1 1 

If: i | l 2(y 1 -bx i -o(-x i4 ) = o ( 



n 



- I (-2 yi x.+2bx. 2 +2c\.) = 0, 
i = l ' 1 1 1 

, finally, . . • — — 

f n f n n 

I bx i + I cx = I x y . 
i=l 1 i=l 1 i=l 1 1 

* To continue with the other derivatives: 



H = J i 2(y r bx r c)(-1) = 0 
n 

■ 2 I (-y.+bx.+c) = 0 
i = l 1 1 



and 



ii ii ii 

i=l 1 i=l i=i 1 



Thus our two equations which are traditionally 

called. normal equations are: 

n ~ , n 

(3) b r - " 



I x. » + c T x. = y x-y . > 
i-3 1 i = l V v i=l 11 



n n 



(4) b I x + nc = p y 

i-1 i=l 1 

In order to solve these equations, we must calculate 

the indicated^sums as is done in Table 4. fte have also 

included the table of'y., 's because we can use the sum 

n 2 •* 
^j^i t0 ^i n d-»the line of regression x = b'y + c 1 . 

12 - . y 



-\ -• ' 

The normal equations for this line are obtained merely 
by interchanging x and y in the original two equations 
(3) and C4). ■ , ' ' 

TABLE A 







2 


2 


, ^ ^ 


X 


y 


x 


y 


xy 


25 


3'0 


625 


» 900 ' 


750 


30 


A6 


900 


, 2116 


1380 


50 


• 51 


2500 


2601 


2550 


20 


28 


A 00 


78A 


560 


70 * 


/ A8 


'A 900 


230A 


3360 


80 


^ 88 


6A00 


77^ 


.< 7OA0 


91 


75 


8281- 


5625 


6825 


A6 ■ 


52 


2116 


270A / 


2392 


35 » 


35 


1225 


1225 / 


1225 


25 


28 


625 


78M' ' 


700 


80 


^95 


* 6A00 


90^5 


7600 


552 


576 


3A372, 


,,35812 


3 A 382 






3 





(3') 
(4') 

(3) 
and 

(4 7 
Thus , 



As an example, for x = b'y + c ' we have: 

n - n n 

i=l i=l 1 i=l 1 1 

n n 
b ! I y. + nc 1 = I x :. 
i = l A " i=l 1 



From Table 4, our equations becdmep 
34372b + 552c = 34382". 



552b + 11c = 576. 

11c = 576 - 552b 
1 r _ 576 - 552b 

n ' 



Substituting the Value of c into (3) we get 

1 13 
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34372b + 552 [ 576 ' SS2b ) = 34382 



578202 

60250 

f 

0.8209789 
11.165422. 



, "378092b + 317952 - 304704b 

73388b 
' 4 ■". b 
and c 

Hence, y = 0.8209789* + 11.165422. Similarly 

(3') ^ 35812b' '+ 576c' = 34382 

(4\) 576b ' + lie 1 = 552 

i ' 11c 1 = ^552 - *576b' / 

a „, 1 552 - 576b' 



Substituting in (3') we get 
3Sai2b' + 576 



[552 



, 576b 



. 393932b' + 317952 



34382 

378202 
60250 
0.9693352 



and- 



11 

331776b' 
62156b' 
•b ' 

c' = -0 .'5760972 

v . .1. . 

x = 0.9693352y - 0.5760972. 

So, we now have the lines of best fit with respect 
to y and with respect to x. , (See Figures 4a an<W4b.) 
We can use either one, depending on our needs. ' Further 
than that, having the two lines allows us to calculate what 
is called the coefficient 6f correlation. 

) 

4.- COEFFICIENT OF CORRELATION * 

* \n order to get ^ -numerical indicator of how well 
the two sets of 'scores compare, we take the geometric mean 
of the slopes of the two fines of regression (i.e., r = t/EF 1 ") 

9 




The sign is chosen to. be negative if both slopes are 
negative, and positive if bofh slopes are positive. This / 
' vaUue, which ranges from '-1 to 1 is called the coefficient ' 
of *c^rrelat ion . If we have good correlation the.value r 
is cl6se to ll Poor correlation is indicated by a value 
near 0. Tf high values of one characteristic are associated 
with low values of the ot*her v the correlation is considered 
negative. Observe the distribution of points in the 
graphs of Figure 5. , r 



the*ir 



ouble of finding the lines of regression. With a 
little-'algebra we can w/ite: 



b = 



n 




n 






■ Z , y i 






1 = 1 



n ? t n 
i=l 1 i=l 1 



and 



b" = 



n f n - 

n J x.y. - J y. 

1=1 11 U=i 1 



n 

i=l 1 



2 f 
i=l 1 i=l 1 



r = -0.65 



r = 0 



Exercise 1 . 

Given tjie normal equations (3), (A), (€'), and (A'), use algebra 
to obtain b and b 1 above. 



Since r = /bb ' we can write: 



r = 0.98 



r = 0.4 
Figure 5. 



\ Using the data from the example in the previous 

section w£ have*: 6 





1=1 ^1=1 ;V 1=1 ^ 


2 


1=1 ». ki=l- ^ , 





More simply : 



n £ x.y. 

i=i 11 



n 

i = l 1 



i = l. 
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r- = /ET 7 = /(0 .8209789J (0.9693352) 
=. /0. 7958037 

/ ^ 

= 0.8921. 

The value of r indicates a reasonably % good 
correlation. r \„ 

We can determine b and b' directly from the two 

norma} equations*. This allows us to calculate' r without 
# 



n v f a 12 



n m l - J x. 
i=l 1 l i=l 1 



-j/' 2 • (J/t) ; 



As a check we substitute the indicated suras in this 
new formula: 



1 2 



11 



16 



17 



\ 



r = 



11(34385) - 552(576) 



7(11 (34372) - n ( 552) 2 )(11 ( 3581 2 ) - ( 576) 2 ) 

' - ' = 378202 - 317952> _ 60250 

✓I733fifi)(62156i ~ 67540 

«. « * 

•T = 0.89-20639 = 0.8921 . 

This agrees', with the results obtained b> e/npioying 
the explicit slopes, b and b' of the two lines of 
regression. • - 

5. REGRESSION FOR LOGARITHM IC SCATTERS 



Consider the graph in Figure 6 of adman's growth 
measured every three years after birth. Notice that' 
there is a great deal of growth between birth and 15 years, 
After that time*, growth tapers off. Table 5 g&res the 
data used* in plotting the graph. , 

TABLE 5 



Age 
in Yrs. 


Birth 


3 


6 


9 


12 


15 


18* 


21 


24 


27 




Height 
in Ft. 


1.5 


3 


3.75 


4.5 


5 


5.8 


6.1 


6.15 


6.17 


6.18 





Using the techniques developed in Section 3, we can 
easily fit a line to the data'. ' See the calculations 
below in Table 6. * 1 




Eh 




0 1 ! 1 1 1 ! —I 1 j h 

3 6 9 12 15 18 21 24 27 

* Age in Years 

• / 

Figure 6. % 



TABLE 6 



X 


2 

X 


y 


xy 


0 


0 


1.60 


0 . 


* 3 


9 


2.90 


8.70 


6 


36 


3.75 


22.50 


9 


81 


4.50 


40.50 


12 


144 


5.00 


60.00 


15 


225 


5.80 


87.00 


r ,18 


324 


6.10 


109.80 


'21 


441 


6.15 


129.15 


24 


576 


6.17 


148.08 


27 


729 


6.18, 


166.86 


135 


2565 


• 46.55 


772.59 











-1 



Using b£x + l c£x = £xy 
b£x + cn ■ £y. 

Therefore we can write: 



2565b + 135c = -772 . 59 
135b ,i 10c = 46.55 

46.55 - 13Sb 



c = 



nr 



arid we can further write 

f46.55 - 135bl 



- ,2565b + 155 

25650b + 135(46.55) - 
25650b + 628*4 . 25 



TTT 



(l35)*b 
18225b 
7425b 
b" 
- b 



= 772.59 

'7725 .9 
7725. % 
1441 . 65 
f4*4U 65/7425 
0.1942 
2.0333 



and we have our 'line of regression: 
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y = 0.19.42x +* 2.J0333. 



*In order to draw the line we need only locate two 
points.. ( .* , * 



For x = 0, y = 2.0333, 
for x = 3, y = 0.1942(3) + 2.0333 



2 .6159. 



While this is not a bad fit, we can do better; It, 
turns Cvfift that /the jiata will fit a logarithmic' curve 
much better ^feah a straight line. In. general, logarithmic 
curves look^i^^^he^bne shown in figure 8. 

We can tak v elsk£log e * of each of^the x, values (age in 
this example) . We the^^^^^the same technique of least 
squares to find a log Jine^^est fit. The calculations^- 
are given below. Notice how mucn^^oser v this curve is to^. 
the actual data. . ~ * *. *^ 5 ^^____ 



*Log e is also written Iriv^ We are using 'log e here to emphas'itfa ). 
the general nature Qf logarithms^ V©- can arbitrarily -use any base? 




TABLE 7- 



0 
3 
6 
9 
12 

18- 
21 
2* 
27 



log* 



1.0986 
1.7918 
2.1972 
2.4849 
2.7081 
2.8904 
3.0445 
.3.1781 
3.2958 

22.6894 



(-log -x-) - 



1.2069 
3.2105 
4.8277 
6.1743 
7.3338 
8". 3544 
9.2690 
10.1003 
10.8623^ 

61.3392 



2.90 
3.75 
'4.50 
5.00 
5.80 
6.10 
6.15 
6.17 
.6.18i. 

46.55 



3. 1859 
6.7193 
9.8874 
12i4245 
15.5707 
17.6314 
18.7237 
19.6089 
20.3680 



124.1198 



We use - * 

^ . . bL(lot e x) 2 + *cMog e x = Z(log e xj> 

bllog^x + Vn = Zy. 

Therefore we can write: 



therefore 



,61.3392b + 22.6894c = 124.1198' " • 
22 . 6894bs + 9,c = 46.55 

r _ 46.-55 - 22 .6 894b 

61.3392b * 22.6895 [ 46 - 55 " 2 9 2 - 6894b ] = 124.1198 



9(61. 3392b) + 22.6894 (46.55");- (22-.6984) 2 b = 9 ( 1 24 . 1 198) 1 

552.0528b,*- 1056.1915 - 515.2174b ='1117.0782 ^ 

* * . * 36.8354b = 60. 8867 

b = 1.6529 * 



r>9 



17 



* 




« 










* 




c _ 46.55 


✓ • 

- 2*2.6894 (1.6529) 




• 

J 

46. £5 ■ 


• 37.5033* 


* 

V 




9.0407 
9 


9 

= 1*0052 






V 






y = 1.0529 


log c x + 1 . 0052 . - 








let 


X 


= "5 . then y = 


1 . 6529( 1 . ()98t> ) + 


1 


.00 52 = 


2.821. 




X 


= 6 , then y = 


1.6529(1 .^918) + 


1 


.0552 


3.90(>9. v 




X 


= 9, thjen > = 


1 .052^(2. 19" 2) + 


1 


. 0052" = 


4.6 5-7. 




X 


= 12, then y = 


1. 6529(2.4*49) + 


1 


.0052* = 


5.1125. ' 




X 


= 15, then y = 


1 ,6529( 2.708 1 ) + 


1 


.0052 = 


5.4814. 


• 


x^ 


= 18, then y = 


l'.6529( 2.8904) + 


1 


.0052 = 


5.7827. 




X 


= 21 , then >■ = 


1.6529(5.0445) + 


J 


. 0052 • 


6.037 5. 




X 


= . 24 , then y = 


1.6529(3.1781) + 


1 


.0052 = 


6.2585. ' 




X 


= 2 7 then y ~ 


1. 65^9(3. 2958)" + 


1 


.0052 = 


ft. 4 528. 












• 






7 - 












» - 


6 - 


V 






* * 




*eet 


5 - 




* 










4 - 
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- 




U 
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•H 
O 

4 


3 - 
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2 - 
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) 
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Figure 9. 
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Exetclse 2 . . 

Fit a logarithmic 'curve to the data given in the table below. 





X 


\ 


6 ~- 


11 - 


16 _ 


21 






y 


12 


42 


53 


71 


76 





6, REGRESSION FOR EXPONENTIAL SCATTERS 

• ^ : : ~ 

s 

Consider now, an experiment where a large number of 
corn seedlings were grown under favorable* conditions. 
Every two weeks a few plants were weighed, and the 
average of their weights was O recorded . (See Table. 8.) 
We also give a graph in Figure 10. It would be difficult 
to find a straight line that would fit very well.- The ' 
logarithmic curve does #n fit so well. either. » N 

TABLE 8 



Age 
in Weeks 


2 


4 


6 


8 


10 


12 


14 




18 


20 




Average 
. Weight 
in Grains. 


f 1 

J 


28 


58 


76 


170 


422 


706 


853 


924 


966 





This|set of data is probably best fit to an 
exponential curve. The'general shape of such curves 
(y =< e x ) is given in Figure 11 ^ AlgebraicaVly y = e x 

x. For a general exponential we 



can be written log e y = 
can write: 



ce 



bx 



With a little algebra, we can get a form that will all*ow 
us jto use the least squares method. Analyze the develop- 
ment below. 





lS>g,jf ="bx. ^ 



log e y i log e c = bx or log^y = bx + ;og e c. 

We caQ fin£ the "line" of best exponential fit by 
taking the log^' of the y values and then proceeding with 
the least squares technique,. (See Table 9.) 

t 

j TABLE 9 



\ j 
X \ 


y 


log e y 


2 

X 


♦ 

x(log e y) 


2 f 


21 


* 3.0445 


4 • 


6.0890 


4/ 


28 


3.3322 


16 


13.3288 




58 < 


410604 


36 


24.3624 


76 


4.3307 


64 


34.6456^ 




170 


5.1358 


100' 


51.3580 




422 


6.0450 


144 


^2.5400 




706 


6.5596 


196 


91.8344 


16 


853' 


6.74B8 


256 


107.9808 


' 18 


924 


6.8287 


324 


122. $166 


* 20 


966 


6.8732 


400 


137.4640 


110 




52.9597 


1540 


662.5196 




• 


* 







^e"e 



ping the equation 



;iog^ - bx + iog e c 



in mind, we calculate 



1540b +110 log e c = 662.5196 




- -52-.9S97 - 10 log c 

b « * > — x — 



■ S 



log^c' 



e 



ur 



21 



1540b + U0( 52 - 959 ; 0 ' "Ob J . 662>5196 ; 

1540b + 5825.567 - 121O0b = 6625.196 
3300b = 799.629 
v . b = 0.2423 
log e c = f 2 - 95 ^ 7 10 ".653 . 2 63067 



log e y r 0.2423X + 2.63067. 



For x = 2/ log e y - 0.2423(2)'+ 2.63067 
= 3.11527 

therefore 

y = e 3. 11527 . 2.71828 
= 22 . 5395. 
For x = i 9 log e y>>0. 2423(4) + 2. 6307 



3,1*1527 



therefore. 



36.5946. 



For x = 6, y .= 59.4122 

for^x = 8 r y = 96.4573 " ' 4 

for^x = 10^ y = 156.6008 
for x = 12, y = 254.2454 
for^x = 14, y « 412.7739 

for x = 16, y = '670.1489 1 
for x = 18, y = 10^8.0038 
for x * 20, y » 1766:4019. 

^ Ve could have solved_for _c whenc e obtained 

If yl.°g e c 58 2.63067, then c ± 13.8831, 
there £dre 



y « i3.8831e°- 2423 \ 



If we substitute 2 for x we get a value which is virtually 
the same as we got using the other form. That is, * 



y = 13.8831e 0,2423(2) = 22 . 5395. 
/Observe the fitted curve in Figure 12, 
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Figure, 12. 



Age in Weeks 



Exercise 3. 

Try to fitfthe data for the growth of the corn seedlings 
using IS as a base instead of 10, 

— . , _ 



23 



•28 



7. POLYNOMIAL SCATTERS 

A dyisc was rolled down an inclined plane and the 
distance it travel led, was measured after 0, 2, 4, .... 
seconds. The results are organized in Table 10. 

TABLE 10 



fime (x) 


0 


2 


A 


6 


8 


1Q 


12 


14 


16 


Distance (y) 


0 


i 


3 


5 


8 


12 


17 


23 


29 



We give a graph" of the data in Figure 13. * Notice^ 
that it looks as if it could be fitted to an exponential. 

However, this data fits* closer to a second degree poly- 

* 2 
nomial or a parabola, y = ax + bx + c . 



30 --. 



25 -- 



0> 

s 

C 

0) 

o 



20 



15 



10 -- 



+ 



5 10 15* ,20 

. Time in Seconds 
* Figure 13. , 

In order to fit a polynomial we must do a little 
more mathematics. Notice, that we nowjjave three constants 
to identify, namely a, b, and c. 

We must consider minimizing the sum 

I ty- - (ax. 2 + bx. + c)] 2 . 
i=i 1 1 

11 no 



24 



This means that we must calculate the partial derivatives 
of 'this sum •with respect to a, b, and c. We set these 
derivatives equal to 0 and come up with three equations 
in three unknowns a, b, and c. That development is 
given below: y 

n * ' 

W = J/ 21 ^ " aX i 2 " bX i " Clx i 2 - 

= I (-2x. y + 2ax. + 2bx. + 2cx-") = 0. 
. L , i 7 i ' i l i 

i = l 



4 3 2 2 



JS = -V 2 ^! " 3X i 2 " bX i " ClX i " ^ 

1=1 



4 - I -2[y. - ax. 2 - bx. - c](l) = 0. - 
9c i = i 1 1 \ 

aEx. 2 + bZx i + c£(l) = Ey^ 

7 

a£x. + b£x. + nc = Zy . . 

i i 7 i 



From these normal equations we e can obtain, a best 

4 

parabolio.f it . We .must find the indicated sums Ex. ,- 

3 2 2 • 

Ex.- „ Zx^ , S^o, lx^ y, 'Ex^y:,, and £y^. We give these 

calculations below using the data frpm Table* 11. 



afl40352^ + b(10368) + c(816) =16324. - ^ 

< a<10368)i + b(816) + c(72') = 1218. 
a(816) + b(72) + c(9) = 98 . 

25 



TABLEf 1 I 





2 


3 


4 






2 


1 


i 




x . 
i 


y i 


x . y . 


x. y 


o 


o 




0 


u 


u 


u 


2 


4 




16 


1 


2 


4 




16 


64\ 


L JO 




1 0 
1 L 


/.ft 


6 


36 


216 \ 


1296 


5 


• *30 


180 


8 


64 




4096 


8 


. 64 


512 


■ 10 


100 


1000 


\ 10000 


12 


120 


1200 


12 


144 < 


1718 


\20736 


17 


204 


2448 


14 


196 


2744 


\8416 


23 


322 


4508 


16 


256 


4096 


65,536 


29 


464 


•74 24 






- t 




v — 






72 


816 


10368 


1403^2 


98 


1218 


16324 


To solve this system, we can use an 


✓* 

augmented matri 




"140352 


10368 


816 


163-24* 








1 0368 


816 


72 


1218 








816. 


72 


9 


98 







We first divide the top Vow through by 14*0352 to obtain 
1 in the first row and first column: 



1 

10368 
816 



0.0739 
816 

72 



0.0058 
72 
9 * 



-0.1163 
1218 

9S " 



Next, we multiply the top row by -10S68 and, add it to the 
second row. Then, we multiply the top row by -816 and add 
it to "the bottom row. The resulting matrix is given 
hBlow;. 



*For a more detailed discussion on* matrix manipulations see 
Elementary Differential Equations with Linear Algebra-by Ross. L. 
Finney and Donald Tt. Ostberg. 
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1 0.0739 0.0058 0.1163 
0 423.0528 Jl. 8656 12.2016 
0 41.0736 4.2672 * 3.0992 



' Tt> continue we divide* the second row by 423.0528 to obtain 
y in the second row, second column. 



1 * 0.0739 0.00*58 0.1^63 
0 1 0. 0280 0.0288 

0 41*0736 4.2672 3.0992 



\ 



We now multiply the second row by -41.0736 and add it i q f 
the third row. 



1 0.0739 0:0058 0.1163 
0 1 , 0.0280 0.0288 

0 . 0 .3.1172 1 .9163 



We divide the last row by 3/1172 and obtain c from 
/the system above: > # * 




1 0.0739 0.0058 0:1163 
0 1 6.0280 0.0288 

0 0 1 0.6148 



c =\0.6148. 

b* + 0 x .028(0.6148) = 0.0288 
v b + 0.0172 = 0.0288 



i 



. / a + 0.0739(0.0116) + 0.0058(0.6148) = 0.1163 
/ a + 0.0008572 + 0.003566 = 0.1163 

/ * 'a -0.1119. 

Therefore the parabola of best fit is: 

y = 0.1119x 2 + 0.0116x + 0.6148. 

We obtain the y values below: 

x = 0, y = 0.6148. 

x = 1\ y = 0.1119(4) +0.0116(2) + 0.6148 
= 0.4475 + 0^0232 + 0.6148 
• • . = 1 . 085S. . 
t x =' 4 , y = 1, 66^3, 

4.9684 
7.8692 
11 .9208. 
"l6.8j&76.' 
22.11-04.. 
29.4468. 

When this data is graphed on A the original set of 
axes, we see that we Jiave a very close fit. (See 
Figure 14.) 7 „ 

V 

Exexcise 4 . • - • 

Fl^the data to an exponential. It should be convincing that 
the exponential does xiot «f it as well as the parabola. 



x =' 


4, 


y 


X = 


6, 


y 


X = 


8," 


y 


X = 


10, 


y 


X = 


12, 


y 


X =* 


14, 


y 


X = 


16, 


y 




There are sets of data- that produce scatters *that 
fit higher order polynomials than 2. Eor Example, the 

' • « : . 28 

^ O sJ 



^^^r^-^^&T^-T:tv> /•": -,-v ----- -iir-shoii 

. --£C^- 0 - . --• . , - - • - -v-r--: ' . ~-i 

-- ^ '-.--^j;....- • the- amount o 

■•. • V'iJ' ' ■■ ■ - - /'IW-ith-/ cowjriiter-. pp©grahr-"Jto do the work r 

I- V -."-.<{.-•• j^p ..*.:•:• •->-- •.x : -•• " - . ... •' 



1 



20- " 



15 



10 ry 
5--' 



;uses the -Aaine procedu^-es , jxut you are. "spared the 

- * . \ * - - > - 

ifd also be pointed out that an pr^actTce^ 
)f ddta collected wbul^lnore than like 1 /.be f 
c -"mo re 'extensive. We have also fcept -the numbers", reasonably ,\ 



•'7~ 



- evflfer a . r g e ; tiunibe r o fr da t a Ji nd t h e juimbje r s can b e- 
^eJ-tbeV jrex£ lar£e ,' <orJyery " sjna 1 1 . 



0 




15. 



Figure 14. 



•1- ^> 



^ V^^cre "ar-e. othjejr fuhxtions such 5-s 'powers and powers" 
'J ; v"-' raised to powe-rs -that can, be employed, and data fitted 
- • to,4§eH^i*L;e. , y -.-c^ 1 ,- y = c^ 1 !^, etc*.): Appropriate 
"ija^n ij>ul a^o^n b'fc' the. data can be employed to handle these 
; *" "situat"ion c , "-The basi^c- mathematics of the least square . 
. ^ / methjod can still be used. Hopefully, this material has 
given enough background so that virtually any type of 
.scatter can be fitted. 



corn seedling example in Section-^ might be fit "with a 

TO 

cubic (i,e., y = ax + bx + cx + d) . .. # 

- - -. i 

However, this means "that we- would, have to solve 
four equations in four unknowns (a, b, c, '-d^. This is 
no small task.. Tjjiere are methods for finding the 
.coe£^XCicnts without going through all the work of the 
partial^ derivations, namely, the square' root .method and 
Gau^ 1 ^ method. - ^ 

Tftere is still a great, deal' of calculation ^bo do 
even with\these methods. In fact, all curve fitting 
requires a \ood deaj of Calculation. Now that we have 
computers, weN^ari write programs to deal with any "type 
of scatter. 

We present, as an appendix* a BASIC program called 
"Super" Fit. 11 Aftch^ going through this unrrt the render^ 
should be comfortable with using* the program. The 




31 



29 



. 8, MODEL EXAM 

1. Given the data in^the table below construct a scatter 
diagram: . - » 



2'. 





2 


8 


7 


xo 


15 


18 

« 


15 


18 


23 


23 


25 


25 


'30 


32 


35 


•y 


2 


2 


8 


15 


10 


5 


20 


16 


10 


15 


20 


25 


23 


27 


25* 



For the data. given in Question 1, is the coefficient 
of correlation positive,- negative, or zero? Fit a 
Une by eye through the points of the scatter diagram 
th^t was constructed for Question 1. Fit a line \ 
thorough the data using the least square technique. 

6iven the parabola* y = 2x 2 + 3, let x take on* the 
values 1, 2, 3, 4, 5, 6, and 7. Find the corresponding 
y values. Which type of function — logarithmic or 
exponential — win ,best fit the given parabola? ^ 

r 

orr / 




X 




2 

X 


xy 


2 


2 " 


A 




8 > 


2 


" 16 


16 


7 I 


8 


49 


56 


10 


15 


100 


150 


15 * 


10 


225 


150 


18 


5 ' 


324 


90 


15 


20 


225 


300 


18 


16 


324 


288 


23 


10 


529 


230 


23 


15 


529 


345 


25 


20 


625 


500 


25 


25 


< 625 


625 




I J 


900 


690 


32 


27 


v ' ,1024 


864 


35 


25 & 


7/ -T225 
^ 


875 


253 


223 


* 67.24 


5183 



6724b + 253c = 5183" 
253b £ 15c = 223 > , 

223 - 253b 
° 15 

6724b + 25 3 ( 223 -/ 53 ^] . 5183 " 

6724(15)b + 253(223) - 253 2 b = 5183(15) 
100860b + 56419 - 64009b = 77745 * * 
0 36851b = 21U5 3 6' 

b = 0.5787.' 

Since c = 223 ■- 5 253b we have c - 223 = 

therefore 

c - 5.1059. 

The line. of regression is * 
y - 0.5787x + 5.1059. 

y « {5,11,21,35,53,75,101} r ^ 

An exponential would fit best. 



X 


y 


l0 s e y 


2 

X 


x log e y 


1 


J 


1 AftQA r * 


i 
i 


1 tno/, 

i . buy^— ■ 


2 


1 1 

-I- J- 




A 
** 




3 


* 21 


3.0445 


9 


9/335 


4 


35 


3.5553 


16 


14.2212 


5 


53 


3.9703 


25 


19.85I3 - 


6 


75 


4. .317 5 


36 


25.9050* 


J_ 


101 


4.6151 


49 


32.3057 


28 




23.5100 


140 


107.8221 



140b + 281og e c - 107.8221 



28b + 71og e c = 23.5100 



log e c = 23 - 5 V 

140b + 28 p - 3 - 51 7 " 28 *>j = 107.8221 



7(l40)b + 28(23.51) - 28*b = 7(107.8221) 

980b + 658.28 - 784b = 754.7547 * 

i 

* . 196b = 96.4747 

^ b - 0.4922. 

loe c - 23.^1 - 28(0.4922) 9.7284 _ 

I. , ' 



389fr 



therefore 

c = 4.0139 



We have'y," ce b ? which yields y » 4.0139e°* 4922x ' 
so if 



x 

y 

X 

y 

X 

y 

X 

y 



« 4.0139e°* 4922 £ L) -* 4. 0139 Cl. 63590 6. 5664 
-2 » # 

- 4.0139e°* 4922(2) « 4.0139(2.6762) -10.742 

-? . ' \ 

- 4.0139e°- 4922(3 ) - 4.0139(4.378) = 17.573 



4.01?9e 



0.4,922(4) 



4.0339(7.162) - 2^.747? 



S 



—Up 



3S 



x = 5 * * ( 

y = 4.0139e°* 4922(5) = 4.0139(11.7165) = 47.0289 

x = 6 ' 

y = 4.0139e°' 4922(6) = 4.0139(19.1672) =76.9352 



x = 7 



y = 4.0139e° ,4922(7) = 4.0139(31.3558) « 125. 



8491 . 



130-- 
120-- 

110 -lr« 

100-- 

90-- 
80-- 
70-- 
60- 
• 50 : 
' 40-- 
30"- 
20-- 
10- 

0 



2 3 



X 



• = data 
X = fit 



H 1 h 

5 6 7 



~~ 34 



39 



10. ANSWERS TO EXgRCISES 



1 . Given 



o) bj; Xi 2 + C J x' £ = i x iy± 

•♦i=l 1=1 1=1 



1«7' bj] x + nc = V y. 

*i=l . i=\ * 

using °(4) we can write: 
n n 



nc = I y. - b£ x 
, 1-1 i«l 



n ru 
t - n 



0 * 



Substitute this value of c "into- (3): 
f n . n, 

■i-r 1 |^ , n 



n n 



I *i =* I Vi* 
1-1 1=1 



^ * Mult^ply^the equation obtained by n and remove the parentheses 
* x "* using the distributive lay: 



n n n n 



1=1 i»l 1=1 1=1 i=l 1 x=l 1 f 



Further we can write: 





n 2 


t -\ 
n 


2' 


b 


n £ X i 








1=1 1 4 


*t=i 1 





n n t n 

1=1 1=1 i=l 



n n n 

1=1 i=l 1=1 

B — 

n r n 

«I Vi ~ Z x i 

. 1=1 1 1 1=1 1 



ERLC 



35 



To solve for b' we do a similar procedure:' 

Given ' « 

n 9 n * n , 

(3*) b'l + ej y - \ y.x. 
i=l i=l 1 i=l 1 1 



(4') b'J y + nc = J x., 
i=l i=l 1 



using (4'1 w£ can write: 



n n 
nc = I x - b f X .y. 
i=l 1 i=l 1 




Substitute^ the value of c into (3'): 



i=i 



n n ^ 

X -i - b'Z y. 
i=l 1 1=1 1 



n n 
i=l i=l 



n t n n n n n 

^ + I \ I y x - Xi I y; - nl y.x 
1-1 1=1 i=l 1 1=1 x i=l 1 1=1 1 1 



b' 



? 2 f 5 
1=1 (i=l 1 



n n n 

1=1 i=l i=l 



n n - * n 

«I - * I x J y 

— 1 1 i=l 1 



1=1 1=1 L 



X 


log e x 


Uog e x) 2 ' 


y 


(log e x)y 


1 

6 


0, * 
y'7918 
2.3979 


0 

3.2104 
5.749? 
7.6872 
9.2691 


o 

12 
42 
> 53 
71 
'76 


0 

75.2556 
127.0887 
196.8546 
231.3820 


11 

16' 
21 


* 2.7726 
3.0445 


55 


10.0068 


25.9166 


254 


630.5809 



41 



Use 



2 * 
b I( lo 8 e x ), + c£log e x - J(10g e x)y 

b£log x + ' cn = ly. 



Therefore we can write: 

25.9166b + 10.0068c = 630.5809 

10.0068b + 5c = 254 % 

254 - 10 .0068b 

C = " 5 

/. 25.9166b + 10.0068 jlli^OO^b] = 63Q 58Q9 

5X25. 9166b) + 10.0068(254 - 10.0068b) = 5(630.5809) ' 
129.583b + 2541,7272 + 100.136 = 3152.9045 
v 129.583b = 511.0413 
b = 3.9437. 



Hence t 



254 - 10.0068(3.94 37 ) **\ 

. < — • \J 

- 42.9072 

and , , 

y » 3.9437 log e x + 42.9072. 
Let % V 

x - 1, then y » 3.9437(0) + 42.9072 
- 42.9072* 

x =* 6, y « 3.9437(1.7918) + 42.9072 

» 49.9735 - 
- x - 11, y - 5?. 3638 
x « 16, y - 53.8415 
x - 21, y • 54.9138. 



90, 
80- 
* 70 
60- 

50- 

a 40- 
30- 

20- 



i 

5- 



10 



15 



Graph for solution to Exercise 2. % 



We could use any baseband obtain th& same fit. The calculations 
are given, for a base 10 (common logs) fit. Notice that the y 
values are virtually the same as those obtained for log e « 



X 


y 


lo gl *y 


2 

X 


x(log 1Q y) 


2 


21 


1 


3222 


4 


, 2 


.6444 


4 - 


28 

t 


1 


4472 


16 


5 


.7888 


6 


58 


1 


7634 


36' 


10 


.0580 


8 


76 


1 


8808 


64 


15 


0464 


10 


170 


'2* 


2304 


100 


22 


3040 


12 


422 


2 


6253 


f 144 


31 


5036 


' 14 


706 


2. 


8488 


196 


39 


8832 


16 


853 


' 2. 


9309 


256 


46 


8944 


18 


924 


2. 


9657 


324 


53 


3826 


20 


966 


2. 


9850 


400 


- 59 


7000 


no 

i 




22. 


9997 


1540 


T287 


2054 

• 
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38 



1540b + 110 log c.= 287.2054 

iiOb + 10 log c = 22.9997 

. m 22.9997 - 10 log c 22.9997 - 11.5968 n • , 
b : ■ jjg — = 0. 10366 

therefore 

154 °( 22,9997 U0 l01 ° SC ) + U01 °8 C = 287 - 20W 
35419.538 - 15400 log c + I2100*logc = 31592.594 

3300 log c = 3826.944 
log c = 1 .15968 
c = 14.444. 

x - 20 * 

>y = 14.44^lO) 0 - l0366(20 > = 14.444C10) 2 ' 0732 
; = 14.444(118.3586) - 1709.5716. % - 

x = 18 

y =^-1060. 6879 / 

x = 16 „ 
y = / 658.0932 

x ■ 14 
y = 408.2134 

x » 12 
y » 253.2727 

x « 10 
y m 157.1406 

x » 8 

y = 97.4956 

x -^6 ( 

y » 60.49 

x4<* 

y » 37.5226 ' 1 ' \ 

x'- 2 

y - 23.2808 4 4^ ? 9 



X 


v 


log V 


' x 2 ■ 




— 

0^ 


0 


— oo 






2 


1 


0 


4 


0 


4 


3 


1.0986 


16 


4.S944 


6 


5 


1.6094 


36 


9.6564 


8 ' 


8 


2.0794 


64 


16.6352 


i r\ 
1U 


iz 


2 .4849 


100 


z4 . 8490 


12 


17 


2.8332 , 


144 


33.9984 


14 


23 


3.1354 


196 


43.8956 


16 1 


29 


3.3673 


256 


53.8768 


72 


. 98 


16.60i2 


8l6 


187.3058 



Keeping the equation 



i°g e y = bx + A °8 e c 
816b + 72 log e c = 187.3058 
72b + 8 log e c = 16.6082 



log e c 



16.6082 - 72b 



816b + 72 



16.6082 - 72b 



6528b + 1195.7904 - 5184b 
1344b 
b 



= 187.3058 

= 1498.4464 
= 302.656 
= .2*52 



log e c 



16,6082 - 7,2(.2252) 



= ..0492 . 
the fitted curve is: 



log y = .2252x + .0492. 
e 



for x = l\ log y = .2252(2) +-.b492 



.4996 
.4996 



= 1.6481 



\ 



y « 2.5857 
y - 4.0568 
y = 6.6859 
y = 9.9742 



x = 12, 
x = 14, 
x - 16, 



\ 



y « 15.6677 
y = 24.5818 
y » 38.5673 



38- 
36- 
34- 
32- 

30" 
28H 
26- 
24- 
22 - 
20- 

18" 

16* 

14 ' 

12 -j ' X 

10- • 
8 H X 
6 ^ 

X 

4 H < • 



2 - 



X ^ 

"i — \ — i — t — ti — i — i — r i" 

2 4 6 8 10 12' 14 16 ' 18 



Graph for solution to Exercise 4. 
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APPENDIX* 

Once the' program listed here is loaded into a 
computer, it will be a simple matter to do curve fitting. 
The program is interactive. The user will be prompted to 
give the needed information (i.e., v all x and y values). 

• ^ This program- fits given data to the following types* 
^of curves and plots them: / % 

(1) Linear y = mx + b ; t . ■ ■ ' 

(2) Exponential y = ce mx ; ' 
*(3) Logarithmic y = m log x + b; 

(4) Power y = cx 11 ; and 

(5) Polynomial y = a Q + * *a 2 x 2. + a n " 

Note that Equation (2) can be written as;' log y = mx + log c 
and Equation (4) c^n be written as log y = n log x + log c. 
t Thus, Equation j(2) (3) and (4) can be reduced to linear * - 
equations by simple substitutions, 



- ft. 



1 * 



*The material in this appendix* is adapted from Technical Data 
for BASIC* Programs, Preliminary Version, July 1974, "developed by 
Project CALC/Education Development t Center , 'Inc. 



•4^ 



S U,P E R FIT 



LIST 

1 LET FS = 0 * - 

2 LET M5=2t'.3 

3 LET PI =3. 14 159~" 

4 DIM C$(3),DS(1) 

5 PRINT 

6 PRIM-T n SU c EH FTT "." 

13 PRINT 

14 PRINT "A • *'IVI M UM X = " 

15 INPUT 19 

16 IF I9<>998 THEM 19 

17 .gcsub ^^^ 

18 GOTO 14 

19 IF 19=999 THEN 14 

20 IF 19 = 997 THEN 900 

21 LET L9 = I9 

22 PRINT " MAXIMUM X = " 

23 INPUT 19 

24 IF I9<>998 THEN 27 

25 GOSUF* 980 ' 

26 GOTO 22 

27 IF 19=999 THEN 22 

28 IF* 19 = 997 THEN 900 

29 LET R9 = I9 

30 IF P9>L^. THEN 33 

31 PRINT "EPROP: * MAXIMUM 

32 GOTO 14 

33 PRINT MINIMUM Y = ": 

34 INPUT -1 9 

35 TF I9<>998 THEN 38 

36 GOSUE 980 

37 GOTO 33 

38 IF I9'r999*THEM 33 
39 4 IF 19 = 997 THEN 900 

40 LET P9=I9 

41 PRINT " MAXIMUM Y="i 

42 INPUT. I 9 

43 IF I9<>998 THEN 46 /. 

44 GOSUE 98 » ' / 

45 GOTO 41 

46 ' IF 19 = 99 1 THEM '41 

47 IF 19=997 THEM 900 

48 LET T9 = I9 
49* IF T9>P9 THEN 

50 PRINT " ERF OR : 

51 GOTO 33 

70 GOSUE 800 • 

94 P*iNT '* - 

95 P/INT " X GLITCH =";G8 

96 /PRINT " Y GLITCH ="-:G9 
37 fiOSliP 920 . 



0 



X. MUST EE GREATER THAN MINIMUM X 



70 

MAXIMUM^Y MUST EE GREATEP THAN MINIMUM Y 



48 



Super Fit 



9B' LET R8= 1 . 0 

100 REM , . , . i 

101 F EM J PFEPAFE FOR DATA 

102 REM ■■ ' ' 
1 9*9 LET E9:(F 9-L9)/20* ' 

11? LET E«:(T9-E 9)/20? 

15'/ -DIM S(4),T(4),U(4),V(4),N(4'),M(4) ,F (4) 
160 DIM AC1 l,12),t(U),F(2i) . . 

165 -LET DP: 10 " /, 

M75, FOR IS: 1 TO 4 

176 LET S(I6):0 

177 LET T(I6):0 . t - - 

178 LET U(IS) = 0 , ' ► • 

17<5 LET V(I6):0 « "* ; , 

LET M(I6) = fi 
181 LET E(l6)f tf 
132 LET fJ(IS):;' 
183 NEXT IS 
185 FOR 1 6: 1 TO 21 . 
* 186 LET R (16)30 
I 3 7 IF I6>11 THEM 189 

188 LET P(IO=t! s • 

189 NEXT l< 

198 P EM 

199 FEM INPUT DATA 
20.0 REM ? \ 
"20 1 "PRINT ^ „ » " 
202 PPI-NT 
203 -LET W9=l 

' 20-4 PR°INT "0: 

205 PR I,NT ' 

206 PRINT "* 

207 INPUT 19 . 

208 IF I9<>998 THEN 2 1 1 
209. GOSUB -920 
210" GOTO -206 
214 IF 19:999 THEM- 225 

212 IF 19:997 THEM 903 

213 LET X9:I9 

214 PRINT " Y :" ; 

215 INPUT 19 

216 IF I9<>998 THEM 219 
247 GOSUB 920 

218 GOTO 244 ■ 

219 IF 19=999 THEN 225 

220 IF 19:997 THEM 900 

221 LET Y9:I9 




\ 222 GOSUB 600 

r ' 223 GOTO 205 



EMC 



224 LET W9=P 

225 LET WQ--W9 ; % 

226 IF .W9: 1 THEN 249 * 

221 PRINT • • 

228 PRINT "E: ERASE DATA." 

229 GOTO > x - . , 

248 GOSUB 500 ~, • . , 

249 PRINT . 

i 4-4 



• . . • * i m • Super Fit 

383 PPINT 

391. PRINT " DEGPF.E OF* POLYNOMIAL: 

392 IMPUT 19' 

393 IF"I9=999 THEN 249 

394 IF 19=998 THEM 391 • 

395 IF 19=997 THEM 391 
398 IF I9<=D8 THEM 401 

III GOTO T 39 1 RR ° R: DEGPEE MUST PE * N INTEGER BE ™ EEN « A.MD" ; D8 

401 IF IMT(I9)<>f9 THEN^ 399 

402 LET D7=I9 „ • • s 

403 IF R(1)> = D7+1 THEN 410 

405 6CT0 T 39 ERR?R: N ° T EN0UGH ^ DATA F ° F DEGREE" ; D7; "POLYMOMI AL FITT 
4.17 REM 

408 REM FIT POLYNOMIAL ■ * 

409 P EM , • 
41? FOR 16=1 TO D7+1 

411 FOR J6=l TO D7+1 _ 

412 LET A(I6,JS)=R (I6+J6-1 ) 
4 13 NEXT J6 

414 LtT * ? (I6,D7+2)=P(I6) 

4 1.5 N£XT '16 . -x / 

4 19 IF D THEN 4 73 ' - ' 

420 FOR 16=1 TO D7+1 

421 IF A(I6,I6)<>0 THEN 450 

429 I*F I6 = D7+1 THEM 3^9 " ■ 

430 FOR J6=I6+1 TO D7+1 

. 43 I IF A (J6,I 6)<>0 THEN 440 
4 32 NEXT J6 • 
433 GOTO 399 
44? FOP 'K6=l TO D7+2 

441 LET T7=A(I6,K6) \ 

442 LET AUS,K6)=A(J6,K6) 4 1 

443 LET A(J6,K6)=T7 ' 

444 NEXT -K 5 . 
45* LET T7=A(I6,I6) 

451 FOR J 6=1 TO D7+2 

452 LET A(I6,J6)=A(I6,J6)/T7 

453 NEXT J6 • 

455 FOR J6=l TO D7+1 

456 IF J6 = I6 THEN 465 
450 LET R7=A(J6,I6) 
461 FOF K6=l TO D7+2 

H\ ^J T A ' ( «i S » K6)=A{J6 .K6)-R7*A(I6,K6) 

4 00 NEXT K6 , 

•465 NEXT J6 , 

466 NEXT 16 . • 

470 IF A CD7+1 ,[>7+l X3 THEN 399 

Hi t E JJ ( S 7+ ^ D7+2) =4 ( r +1 » D - 7+2)/A(D7+ i.D7+i) - 

473 PF INT THE PfodYNOMIAL IS: " 

474 PRINT " Y = ";A|(l\D7+2) 

475 1/ D7=0 THEN 383 



475 LET Ji>=" + ' 
477 LET tt=Ab5(A(2,r>7+2)) 
m IF A«5=f(2,D7+2) THEN 480 
479 LET DS:"-"' 



ERJC 



-T* ^ 



4 



Super Fit 



250 PPINfT "F: FIT DATA WITH CUFVE." 



0 

ERJC 



tNjT "Ft 
tWT " 



TYPE OF CUPVE" ; 



251 PPI 

252 INPUT CS 
251 IF C$r"LiN" THEN 337 

254 IF C$ = "EXP" THEN 328 

255 IF CS = "LOG" THEN 345 

256 IF C$ = "POW" THEN 366 

257 IF C$="POL" <JHEN 3*1 

253 IF CJ.<>"998" THEM 2SI 

259 GOSUB 920 

260 GOTO 251 

261 IF C$ = "999" THEN 1010 

262 IF C$ = "997" TliEN 900 

263 GOTC 251 
300 REM 

301, REM • FIT CURVES 

392 F EM 

307 LET G6=i 

30B PPINT " LINEAR FIT." 

317 GOSUB 1 100 

318 IF F9=0 THEN 327 

319 LET D$r"+" 

320 LET A6=ABS(B ( 1 )) 

321 IF A6=E ( 1 ) THFN 323 

322 LFT D$="-" 



323 PPINT " 
.324 PRINT D$; 
325 PPINT A6 

327 GOTO 248 

328 LET GS=2 

329 PRINT " 
338 GOSUP 



100 



Y=";M( 1 );"*X 



EXPONENTIAL FIT." 



LOGARITHM! C FIT." 



340' PPINT 

341 PPINT " 

342 PRINT " 

344 GOT0*248 

345 LET G6=3 

346 PRINT " 

355 GOSUB 1100 

356 IF F9=0 THEN 365 

357 LET D$':" + " 

358 LET A6=ABS(B(3)) 

359 IF A6=E(3) THE* 361 
36tf LET D$="- 

361 PRINT " 

362 PRIN1 Di; 

363 PRINT A St 

365 ' t GOTO 248 > 

366 LET G6 = 4 
367^?RINT " 




339 IF F9=3 THEN 344 

,Y=";EXP(B(2) );"*EXP(";M(2);"*X) > 
WHICH IS EQUIVALENT TO:" ' 
Y =" ; EXP (B (2 ) ) ; "£( " ; EXP (M(2 ) ) ; " TX ) 



Y=";M(3);"*LN(X)"; 



\ 



POWEP FIT." 



376 GOSUE 1 100 

377 IF F9=0 THEN 380 



378 PRINT " 

380 GOTO 248 

381 LET G6=5 

382 PFINT " 



Y = ";EXP(E (4));'^<XT";M(4);") 



POLYNOMIAL FFT.' 



51 



46 



r 




ERIC 



SUp6r Fit 



632 LET V(2)=V(2)+W9*X9 

533 LET U(2)rU(2)+V'9*Y8 

534 LET T(2)=T(2)+W9*X9*Y8 

535 LET S(2)=S(2)+W9*X9*X9 
636 LET :K2)-N(2)+W9 

543 IF X9<i,C THEN 650 
64 1 IF Y9<=f THEt' 650 

642 LET X?=L0G(X9) 

643 LET' Y8 = L0G(Y9) 

544 LET V(4)=V(4)+W9*X8 
,,645 LET IJ(41 = U(4)+W9*Y8 

646 LET T(4)=T(4)+W9*X8*YF 

647 LET S(4)=S(4)+V9*X8*X8 
6^8 -LET NC4)=N(4)+WQ 

550 IF X9< = 0 THEN 660 

651 LET X8=L0G(X9) 

652 LET V(3)=V(3)+W9*X8 

653 LET U( 5)=ll<3)+V9*Y<5 • 

654 LET T(3)=T(3)+W9*X8*Y C > * 

655 LET S(3)=S(3)+W9*X8*X8 

656 LET N(3)=N(3)+V9 
66tf LET X8=Y9*W9 

661 FOI? I 6= J TO* D^ + l\ 

662 LET 0(I6)=P(I6)+X3 
563 LET X8=X8*X9 

664 NEXT 16 . * ' ' 

67<! LET X8 = W9 

671 FOR 16=1 TO 2*D8+1 

672 LET F (I 6)=P (I6)+X-B 

573 LET X8=X3*X9 v ' 

674 NEXT 16 • ' 

700 REM 

731 REM PLOT POINT 
7JI2 REM 
71^ GOSUB 94C» 
71 1 GOSUB""950 
720 LET H9=X9-E9 
■721 LET WS-Y9-( l-W9)*E8/2 
722 GOS JB ">6fc 

730 LET H9="9+E9 ' 

731 LET V9=Y9+( l-W9)*EP/2 

732 GOSUB^/970 

740 LET H9=X9+( l-W9)*E9/2 

74 1 LET V9=Y9-EF 

742 GOSUB 960 

750'LET H9=X9-(l-W9)*E9/2 

751 LET V9=Y9+E8 
.752 GOSUB 970. 
'760 GOSUB 990 

765 RETURN • *■ 

79 7 REM 

798 F EM ' SUBROUTINE* TO OF AW A*ES 

799 REM * ' . 

800 LET Z 7=INT(LOG( (R9-L9)/10)/LOG( 10)+100)- 100 
801- LET Z8=(R9-L9)/H0t(Z7+l ))■ 

872 .LET Z 5=INT(L0G( (T9-B9)/l?O/L0G( 10)+100)- Iff) 

833 LET Z S=(T9-P9)/( 10TCZ5+1 )„) ' 4? 

*3 * 



480 PRINT " 
4? 1 PRINT D$; 
482 .PRINT A6;"X M 
. , 483 IF JD7= I THEN 383 •> . 
48^ FOP I6r3 TO D7+1 

485 LET AS=ABS(A(IS,D7+2)) 

486 LET D$:"+" 

487 IF A6=A(I6,D7+2) THEN 489 • 

488 LET D3 - .:"-" 

489 PRINT " 

490 PRINT D$; 

491 PRINT A6;"Xt";IS-l 

492 NEXT 16 
_ 494 GOSUE 500 

495 GOTO 383 . • 

500 F EM 

501 REM PLOT FITTED CURVE 
5^2 REM 

510 GOSUE 940 
'511 GOSUE' 950 
52? FOP H9=L9 TO P9 STEP (P9-L9)/N5 
530 IF G6>1 THEN 540 
.531 LET V9 = M( 1 )*H9-f£ ( 1 ) 
532 GOTO 580 f 

540 IF G6>2 THEN 55,0 

541 LET V9 = EXF(M(2)*.H9+B(2))- . 

542 GOTO- 580 

550 IF", G6>3 THEN 560 
55.1 LET V9 = T9+1 

552 IF H9<=0 THEN 580 

553 LET V9 = ^(3)*L0G<H9)+E (3)* 

554 GOTO >Pf 

,560 IF G6>4 THEN 5 70 

561 LET V9=T9+1 i * 

562 IF H9<=0 THEN 580 

563 LET V9 = EXP(M(4 , )*L0G(H9)+E (4)) 

564 GOTO 580 

570 LET X8=l 

571 LET V9=0 ' - 

572 FOR 16=1 TO D7+) 

573 LET V9=V9+A-(I6-,D7+2)*X8 

574 LET- X8=X8*H9 
' . 575 MFXT 16 

, 580 GOSUE 970 
590 NEXT H9 * ' * 

A ' 592 GOSUB 990 . \ 
*" 595 RETURN 

I 600 REM 

f 601 REM CALCULATE SIGMAS 

. 602 REM 

620 LET. V( 1)=V( 1 )+W9*X9 

621 LET U( 1)=U( !)+W9*Y9 

* 622 LET T( 1)=T( 1>+W9*X9*Y9 
623 LET S ( 1 ) =S ( 1 )+W9*X 9*X 9 
* 624 LET. N( ! ) =N ( 1 )+W9 
, 630 IF Y9<=0 THEN 640 ' 
O 651 LEJ Y8=L0G(Y9) 

ERIC . ' • 



Super Fit 



866 
867 
868 
369 

Q7'l 
872 
873 

. 874 
875 
876 
88H 

■ 890 
9~tf0 
<V 1 
9 r /2 
9J3 
924 

905 

9?6 
907 
9/8 
909 
9 I ?, 
J I I 



LET H9=H9+G7 
GOSUE 970! 
LET HS-h9-G7 
IF L9> = i In E.N 873 
LET H9 = » J o-G7 
GO SUB 9 7* 
LET H9=H9.+3 7 . " 
GOSUE 970 • / 
NEXT V9 ' 
LET V9=T<> . ' 
GOSUE 970 
GOSUE *.99k» 
FETUFN 
PRINT « 
IF F3<>0 THEN 904 
PRINT 
PFINT 
PRINT 

PRINT "GO TO A ,D,F,F OP"X" 
INPUT C$ 



WARNING: SI-.NCE YOU HAVEN'T ENTERED YOUP AXIS LIMIT 
(FOP THE FI^ST TI1E), YOU'D EETTEP EMTEP A " 



S" 



IF 
IF 
IF 
IF 
IF 



C$( 1 
C$( 1 
C$( I 
C $( I 
C"S( 1 



:"D" 
... 

_"X" 



THEN 
THEN 
TKL.N 
THFN 
THEN 



92 H 
92! 
939 
94^ 
949 
95? 
959 
960 
969 
970. 
979 
980 
9*9 
993 
■ :>99 
it; 1/1 
1/111 

KM 2 
102 4 
1*21 
1022 
1023 



GOTO 905 
GOSUE 98? 
GOSUE 83/ 
PETUFN 
REM TURN 
RET.UFN 

PEM LIFT f FN 
FETUFN ^ 
F EM PLOT -,POI^ 
FETUR*] . . 
PFH ;-»LOT LIME 
FETUFN 

PEM r r ASE ?ICTUPE 
PETUP.N 

FEM T UP N -OFF PLOTTEP 
P ETUR N 



13 

224 
249 
101? 



'J 

Of* PLOTTER/AXIS LIMITS 



FEM 
F EM 
r EM 
PRINT 
PRIMT "X: 
'INPUT C$ 
IF CSC1 , 1 ) 
1Z24 L? C$( b!) = 
l?25,:fT*iC$<>"998 
l/P.S^GOS'UE 920 
H'27 GOTO 1 02 1 - — 
1028- IF C$:"999" 
1029 IF C$="997" 
1032, GOTO 1021* 
1033* FOR 16=1 TO 
If 34" LET,JS(I<9)=3 



SUEFOUTINE TO 'EFASE ALL DAT.A 



ERASE ALL DATA' 

' THEN 230 
~"Y " THEN 1033 
THEN 1328 . 



THE N' 1021 
THEN 9™ 



» 

•i 



49 



, 804 LET G8sl0tZ7 | 
8.15 IF Z8>5.0001 THEN 813 ! 
806 IF Z8>2.0001 THEM' 81 I • «" * ! 
. 8*7 IFZ8>I.00O1 THEN 80? ' * »J 

803 GOTO 81 4 I 
, °09 LET G8=2*G« i 
«I0 GOTC 814 
811 LET G3=5*G8 
3I2 G0T0'3I4 
. 313 LET G8=10*G8 ' 

814 Let G9=i.ajz5 • 1 

315 IF Z6>5f.0?01 THEN 82*3 

316 if zc>.Vf0!M Then «2i 

V 8I7 IF Z6>l .0015 1 THEV 81 9 ' 
*I8 GOTC 824 

819 LET GQ=2*G9 - ( ' 

82? GOTO 824 f s . 
321- LET G9=5*G9 . V 

822 GOTO 824 
323 LET G9=I0*G9 
827 >PETUPN 
830 GO SUB 94 0 . 
83T LET V/9 = 0 
*32 IF B9"<:f THEM «34 
«33"LET V9=F9 
~l 834 IF T9>=0 THEN 836 
\S "35 LET V9 = T9 
«36 LET H9=P9 
,337 GOSUB 960 
'838 LET G7=(T9-E9)/200 

839 FOP H9 = INT(L9/GR- . I )*Gg TO RQ+G3/1A <?TEP G8 
• 340 GOSUB 970 . " 

841 IF T9< = 0 THEN P4!S * 

842 LET V9=V9+G7 
. • 843 GPSUB 970 

844 LET V9=V9-G7 

845 IF B9> = 0 THEN ' 849 
8^6 LET V9=V9-G7 

847 GOSUB 970 

848 LET V9=V9+G7 
g . 34? GOSUB 973 

350 NEXT H9 
851 LET H9=R9 
' 852 'GOSUB 970 
«53 LET V/9-3S 
854 LET H^=0 
. 355 IF L9<=0 THEN 857 

856 .LET H9=L9 ( * 

857 IF P9>=0 THEM 859 , 

858 LET H9=P9 

859 GOSUB 960 * ' 55 ' 
86.0 LET V9=P9 

. 861 GOSUB 970 
F62 LET G7=(P9-L9)-/20fl 

863 FOR V9 = INT(E9/69- . I )*G9 TO T9+G9/10 STEP G9 
P64 GOSUB "970 ' - 

d 865 IF F9<t0 THEN 369 
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* 1^35 LET UlS)z? < 

l?36 LET U(L6)=a 

If 37 LET V(I6) = <^ 

103S LET M(I 6) = P 

l?^-> LE^P(I6)={1 

124-J LET M CI 6) =0 

1 04 | MFXT I C> 

FOP IS:! TC D«+l 

1 i* 4 3 LET 0(1 6) = 0 
. 1*44 NEXT 16 • 

|»»4 5 F'lF r s- 1 jo 2*D«+] 

l-MS LiT !*(I6) = ^ 

1?4 7 N~XT Tr 

1*49 GOTO 203 

I I 04 P. EM 

I 1*1 PEN SUPPOUTINE TO FIT CURVE 

I I 02 F EM » 

1 l?9 PPINT * 
111?. IF N(GS)>I THEN 112? 
1 I 1 1 LET F9 = ? 

1112 PPINT "NOT ENOUGH DATA FOF FIT" ' 
1113. GOTO 1 13P • t 

112/ LET DD = N(G6)*S(GS)-V(G6)*V(G^T 

1121 LET M(G6) = (N(G6)*T(G<$)-V(GC)*U(GS))/09 

1122 LET E(GS):(S(G6)*U(G6)-T(G6)*V(G6))/D9 
I 123 LET F9=l 

I 13H f< ETIJF N • 
END • 
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example, instructor, friends, or other books) in order to understand the unit? 

A Lot Somewhat A Little Not at all 

4. How long was this unit in comparison to the amount of time you generally spend on 
a lesson (lecture and homework assignment) in a typical math or science course? 

tfuih Somewhat About - Somewhat Much 
Longer Longer the Same Shorter Shorter 

5. Were any of the following parts of the unit confusing or distracting ? (Check 
as many as apply.) 

Prerequisites 

Statement of skills and concepts (objectives') 



c 



Paragraph headings 
_Examples 

Special Assistance Supplement (if present) 
Other, please explain 



6. Were any of the following parts of the unit particularly helpful? (Check as many 
as apply.) 
Prerequisites 

Statement of skills and concepts (objectives) 

Examples 

Problems 



Paragraph headings 
JTable of Contents 

"Special Assistance Supplement (if present) 
Other, please explain 



Please describe anything in the unit that you did not particularly like, 



Please describe anything that you found particularly helpful. (Please* use the back of 
this sheet if you need more spa^e.) 



Er|c / 53 



umap 



UNIT 453 



LINEAR PROGRAMMING IN TWO DIMENSIONS: 



/ 



ERIC 



AN * ' Tb Ail l.x 'AT . >\ ' - 1 ~ 



U S DEPARTMENT OF EDUCATION 
NATIONAL INSTITUTE OF EDUCATION 

EDUCATIONAL RESOURCES INFORMATION 
CENTER (ERIC) 
>"*TKi$ document has been reproduced as 
received from the person or organisation ' 
originating it v 
Minor changes have been made to improve 
reproduction quality 

• Pomts of view Of opinions stated m this docu 
ment do not neces&dnly represent official NlE 
posuioo or policy* 



by 



Nancy S. Rosenberg 
Riverdale Country School 
Bronx, N.Y. 10471 



LINEAR PROGRAMMING IN TWO^DIMENSIONS: 



by Nancy S. Rosenberg 



) 

"PERMISSION TO REPRODUCE THIS 
MATERIAL 1n MIQROFICHE ONLY 
HAS BEEN GRANTED BY 

* ' ■ 'V. 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC)." 




APPLICATIONS OF HIGH SCHOOL ALGEBRA 
TO OPERATIONS RESEARCH 

edc/umap RRchapel st / new ton, mass OksJTO 



sa 



TA BLE OF CONTENTS 

1. LINEAR PROGRAMMING PROBLEMS 1 

1.1 .Examples of Linear Programming Problems 1 

1.2 The Characteristics of Linear Programming Problems . . 1 

1.3 What is Linear Programming? 2 

2. A SIMPLE PROBLEM IN LINEAR PROGRAMMING 3 

2.1 Formulating the Problem . r . * 3 

2.2 Graphing the Problem 7 

2.3 Solving the Problem '.10 

3. CONCLUSION . . . « - 14 

4. SAMPLE EXAM 15 

5. ANSWERS TO EXERCISES V 16- 

6. ANSWERS TO SAMPLE EXAM 20 



GO 



Intermodular Description Sheet : UMAP Unit 453 

Title: LINEAR PROGRAMMING IN TWO DIMENSIONS: I v 

Author : ' Nancy S. Rosenberg „ ^ 

Riverdale Country School 
Bronx, NY 10471 

■A 

Review Stage/Date : 2/8/80 

Classification : APPL HIGH SCHL ALG/OPERATIONS RESEARCH 

V 

Prerequisite Skills' : 

1. Understand what* is mc/ant by "first degree eguat*ion. M 

2. Be able to graph linear equations and inequalities. 

3. Be able to graph and solve simultaneous sets of linear 
equations .in two unknowns. 

Output Skills : 1 ' 

1. Be able to formulate simple linear programming problems 
and solve" them graphically. 



This module was written with support from The Klingenstein Cent 
Teachers College, Columbia University. 



61 



© 1980 EDC/Project UMAP 
_ ^ All rights reserved. 



^MODULES AND MONOGRAPHS 1$ UNDERGRADUATE 
MATHEMATICS AND ITS APPLICATIONS PROJECT (UMAP) 

The goal of UMAP is to develop, through a community of users * 
and developers, a system of instructional modules in undergraduate 
mathematics and its applications which may be used to supplement 
existing courses and from which complete courses may eventually be 
built. . I 

The Project is guided by a National Steering Committee of 
mathematicians, scientists, and educators. UMAP is funded by a 
grant from the National Science Foundation to Education Development 
Center, Inc., a publicly supported, nonprofit corporation engaged 
in educational research in the"U.S« and abroad. 

PROJECT STAFF ' 



Ross L. Finney 
Solomon Garfunkel * 

Felicia DeMay 
Barbara Kelczewski 
Paula M. Santillo 
Donna Diduca 
Janet Webber 
Zachary Zevitas 

NATIONAL STEERING COMMITTEE 

W.T. Martin 
Steven J. Brams ' 
Llayron Clarkson 
Ernest J. Henley 
'William U. Hogan 
Donald A. Larson 
William F. Lucas 
R. Duncan Luce 
George Miller * 
Frederick Mosteller 
Walter E. Sears 
George Springer 
Arnold A. Strassenburg 
Alfred B. Willcox 

The Project would like to thank Calvin J. Holt, Jr. o/£ Paul 
D. Camp Community College, B5rbara Jui-ster of Elgin Community. 
College, Peter A; Lindstrom of Genesee Community College, and 
Harvey Braverman of New York City Community College for their 
reviews, and all others who assisted in the production of this unit. 

This material was developed with the partial support of 
National Science Foundation Grant No. SED76-19615 A02. Recommenda 
tions expressed are those of the author and do not necessarily 
reflect the views of the NSF, nor of the National Steering 
Committee. • ' 



Director 

Associate Director/Consortium 

Coordinator * 
Associate, Director 

Coordinator for Materials Production* 
Administrative Assistant 
Project Secretary 
Technical Typist 
Staff Assistant 



M. I.T. (Chair) 

New York University 

Texas Southern University 

University of Houston 

Harvard University c 

SUNY at Buffalo 

Cornell University 

Harvard University 

Nassau Community College 

Harvard University 

University of Michigan Press 

Indiana University 

SUNY at .Stony Brook 

Mathematical Association of America 



1. LINEAR PROGRAMMING PROBLEMS 

. - » 

1.1 Examples of Linear Programming Problems 

Several years ago, a major grain supplier decided to 
produce chicken feed from a mixture of grains and food 
supplements. Each'of the possible ingredients 1 had a 
different price, ancj each contained different proportions 
of the' various nutrients that chickens need each day. 
The question was Ais: Which ingredients, in which pro- 
portions, should be combined to meet the nutritional 
needs of the chickens as inexpensively as possible? 

4 

The producers of a Broadway musical were designing 
an advertising campaign. They planned to advertise 
through several different media. Each type of advertise- 
ment was known to reach different numbers of people in 
various income brackets, and each had a different cost\- 
The producers 'knew how many people they had to reach ift 
each income bracket if the campaign were to be success-! 
ful. How should they distribute their advertising 
dollars among the various media" in order to have an 
effective campaign at the minimum possible cost? 

A farmer planned to^grow several crops, each of which 
required different amounts of irrigation and acreage. In 
addition, the labor costs 'associated with each crop were 
different, as were the selling prices. -Naturally, the 
farmer had limited amounts of water, land, and capital 
available. How much of each crop should she plant in or- 
der to maximize her profits? * 

1.2 The Characteristics of Linear Programming Problems 

What do these three problems have in common? First, 
they all involve quantities that can be assigned a whole 
range of possible values at the will of the problem sol- 
ver. The grain supplier Can decide which ingredients he t 
will use and in which proportions he will use them. The 



Broadway 'producers can choose to run different numbers 
of advertisements on radio and television or in news- 
papers and magazines. The farmer can plant varying 
amounts of many possible crops , These are called con- 
trollable variables . Second, all three problems involve 
conditions that limit the range of values that these 
variables can assume. The, grain supplier must meet the 
nutritional needs of the chickens, the producers must 
reach certain numbers of people, and the farmer must stay 
within the limits'of the available water, capital, and 
land. These are the -cons traints . Third, each problem / 
has as its object the minimization or maximization of a/ 
critical quantity. The grain supplier and the producers 
wish to minimize their costs; the farmer wants to maxi/ 
mize her profits. Taken together, these are some of the 
major characteristics of linear programming problems/ 

4 / 

1.3 What is Linear Programming? ' j 

Linear, programming is a mathematical technique for 
achieving the' best possible results *in a situation /that 
is governed by restrictions^ It' is* not to be confused 
with computer programming, which is programming of an 
entirely different sort. Of the many quantitative pro- 
cedures, that are now used as aids in decision mal/ing, 
linear programming is one of the most successful/.* It is 
applicable to a wide variety of situations, and it has 
already helped to save many millions of dolla/s. 

The word "linear" refers to the fact that the mathe- 
matical equations used in a linear program a/re equations 
of the first degree. In two dimensions, tWse are the * 
equations of straight lines. Anyone who>ean graph linear 
equations and inequalities in a two-^mens ionaJL coordi- 
nate system and solve them simultaneously can learn to 
solve simple linear programming problems. 



2. A SIMPLE PROBLEM IN LINEAR PROGRAMMING 



2,1 Formulating the Problem 

Let us return to the problem of producing an econom- 
ical feed for chickens. For the sake of simplicity, we 
will consider just two of the feed's ingredients, corn 
and alfalfa. (Although the reasoning used here is simi- 
lar to that used in solving real life problems, the \ 
numbers have been altered to simplify the computations.) 

Suppose that corn is priced at 64 a pound, alfalfa 
.at 8* a pound. Each pound of corn contains 2 mg of pro- 
tein, 1 mg \o£ thiamine^ and 14 mg of fat. (Mg stands 
for milligram," a very small unit of weight. There are 
1D00 milligrams in a gram and 28.4 grams in an ounce.) 
Each pound of alfalfa contains 1 mg of protein, 5 mg of 
thiamine, and 25 mg of fat. Animal nutritionists have 
determined that chickens require, at a minimum, 15 mg-of 
protein per week* and 30 mg of thiamine. It is also known 
that chickens will not eat more thdn 285 mg of fat per 
week. This information is summarized in Table I below. 



TABLE I 



* 





protein 


thiamine 


fat * 


cost 


corn 


2 mg/lb - 


1 mg/lb 


14 k mg/lb 


64/ lb 


alfalfa 


1 mg/lb 


5 mg/lb 


2$~mg/lb 


8*/lb 


minimum 
required . 


15 mg 


30 mg 






maximum 
allowed 






285 mg 





Given these conditions, how many pounds of corn and how 
many pounds of alfalfa must be mixed together to meet 
the chicken's weekly requirements at the lowest possible 
cost? • * 



The first step in formulating a linear programming 
problem is to assign symbols to the controllable 
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iriables, in this case the number of pounds of corn and 
the nurolier of pounds of alfalfa that are to be used in 
the chicken r ^we^ekly feed. 

Let x = the number^Cpounds of corn to be used. 
Let y = the number of pouird-s^of alfalfa to be used. 

Now the constraints dan be stated^n^terms of x and- 
y. We will start with the protein cons trairftv^Si nee 
each pound of corn contains 2 milligrams of protem>^the 
number of milligrams of proteirTin x pounds of corn wi^l" 
be 2x. In the same way, the number of milligrams of 
protein in y pounds of alfalfa will be ly, # or simply y. 
Then the total amount of protein in the corn and alfalfa 
mix will be 2x + y. And since each ch'icken needs 
least 15 milligrams of protein every wSek, we know that 
2x +\v must be at least 15. In algebraic terms, 

2x + y > 15. 



Similarly, since each gram of corn contains 1 milligram 
of thiamine and each gram of alfalfa contains 5 milli- 
grams <of thiamine, i^i order to*have*at least 30 milli- 
grams of thiamine in the chicken's weekly feed we must 
be sure that 

x + 5y ^ 30. 

Unlike the constraints on the protein and thiamine, 
which set minimum values, the constraint on the fat sets 
a maximum value. The fat content in the chicken's weekly 
feed cannot exceed 285 milligrams. Since the coHn will 
contain \4x milligrams of fat and the alfalfa 25y milli- 
grams of fat, it is necessary . that 

. 14x + 25y < 285. 

It is also important to realize that neither x nor V can 
be negative, that is, 

'* x > 0 and y > oJ\ 

Having formulated the constraints, we must state the 
object of the program, which is t.o minimize the cost of 

» r V • 4 



the feed. This cost will be the sum of the cost of the 
corn and the c6st of the alfalfa'. We know 'that x pounds 
of corn at 64/lb^will cost 6x cents; y pounds of alyfalfa 
at 8f/lb will cost 8y cents. The total cost, 
in cents, will therefore" be 

C = 6x + 8y 

where C stands for cost. Because it is our object to 
minimize the value of C, this equation is called the 
objective function. 



The linear program for this problem is summarized 



below. 



Letting x = the number of pounds of corn to be used 
» , \ and y = the number of pounds of alfalfa, to be 
used 



Minimize C = 6x'+ 8y 



% 



'subject to 2x + y > 15 . (protein) 

' x + 5y > 30 * (thiamine) 

* , . 14x + 25y < 285' (fat) 

where x > 0 £^ y > 0. * 

Example 1 . Formulate the constraints and the objective function - 
for the fallowing problem. A bakery must plan a day's supply of 
eclairs and napoleons. Each eclair requires 3 ounces of custard 
and^ 7i minutes of labor. Each napoleon requires 1 ounce of cus- 
tard and 15 minutes of labor.' The^akery makes 40f on each eclair 
that it sells and 30< on each napoleon. If 12u ounces of custard 
.are available, and 10 hours of labor, how many eclairs and how 1 
many napoleons should the bakery make to maximize its profits? 

Step «1 : Assign symbols to the controllable variables". 

Let x = the number of eclairs the bakery should make. 
Let y ■ the number of napoleons the bakery should make. 

Step 2: Formulate the constraints in terms of x and y. 
, Since each eclair requires 3 ounces of custard, x eclairs 

require 3x ounces of custard 1 Similarly, y napoleons 

- €7 ^ ..." " *'s 
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require y ounces of custard. 120 ounces of custard are 
available, so ^ 

3x + y/< 120. 

Eclairs require 1/8 of an hour of labor, napoleons* 1/4 of 
an hour. With 10 hours of labor available, this means 
tifat 

l/8x + l/4y < 10. 

In addition, x > 0 and y > 0. 

5tep 3 : Formulate the objective function. ' 

The profit on x eclairs is .40x; the profit on y napoleons 
is . 30y. The total profit on x eclairs and y napoleons is 
therefore 

t 

P = .40x + .30y. 

Formulate linear piJ^gramSs^for the following problems. ^ 

Exercise 1 . JC* dry cleaning company is buying up to 30 new pressing 

machines and is considering both a 4 deluxe and a standard model. The 

1 

deluxe model occupies 2 square yards of floor space and presses 3 
pieces per* minute. The standard model occupies 1 square yard of 
floor space but presses only 2 pieces per minute. If 44 square * 
yards of floor space are available, how many machines of each type 
should the company buy to maximize its output? 

Exercise 2 . The producers of a Broadway musical plan to advertise 
on New York City buses and on a local radio station. Each bus ad- 
vertisement costs $3000; each radio commercial costs $1000. The| 
producers want trtf^have at lCast one third as many bus advertisements 
as radio commercials. Bus advertisements are known to reach 400 
upper income families, 400 middle income families, and 500 lower in- 
come families each week. The radio commercials reach 100 upper in- 
come families, 1100 middle income families, and 100 lower income 
families each week*. If the producers want to reach at least 2100 
upper income families and 91Q0 middle income families and no more- 
than 5000 lower income families every week, how should they 

es 



distribute their advertising between the two media in order to- 
minimize the cost of the campaign?. < » 

Exercise 3 . A farmer has 30 acres on which to grow tomatoes and 
corn. 1U0 bushels of tomatoes require 1000 ga.llons of water and 
5 acres of land, 1U0 bushels of com require oOOO gallons of water 
and 2 1 i acres of land. Labor costs are $1 pei bushel for both iorn 
and tomatoes. Iht farmer has available 5U.UUU gallons of water and 
$750 in capital, tie knows that he cannot sell more than 50u bushels 
of tomatoes cr 473 bushels bf, corn. If "he makes a profit of $2 on 
each bushel of tomatpes and $3 on each bushel of curn. how many 
bushels of each should he raise in order to maximize his profits? 



2.2 Graphing the Problem 

It is not hard to find pajrs of values for x and y 
that will satisy all the constraints listed in the pro- 
gram formulated in Section 2.1. x = 5 and y = 7 is one 
such pair; x = 8 and y = 6 is another. (Try them.) The 
possibilities are, in fact, unlimited. The question is, 
which of these pairs will give the lowest possible value 
for C? When the problem has only two unknowns, as this 
one does, one way to answer ttiis question is to make a 
graph. 

Since x ^ 0 and y > 0, we shall be interested in 
points in the first quadrant only. This is always the 
case when the variables in a linear programming problem 
represent physical quantities that cannot be negative. 

We will start by graphing the /protein constraint. 
The line 2x + y = 15 is shown in Figure 1, as well as 
the shaded region where 2x + y > 15. The points in this 
region, together with those on the line, are the only 
ones for which it is true that 2x + y > 15. These 
points are hence the only ones that satisfy the protein 
constraint. * f 





10 15 20 25 30 

Figure 1. The points that satisfy the protien constraint. 



Which of these points also satisfy the thiamine con- 
straint? To find out, we must draw the line x ^ 5y = 30 
on the same set of axes and shade in the region above it. 
Only those points which lie in the intersection of the 
two sets of points satisfy both the protein and the thia- 
mine constraints^ (See Figure 2 . ) % 



Because the ^at constraint sets a maximum condition, 
it will be satisfied only by points on or below the line 
14x +25y = 285. In Figure 3, this constraint is combined 
with the other two, and the shaded region now shows those 
points that satisfy all three^f the constraints togeth- 
er. A region like this one is called a convex set. The 
points labelled P, Q and R are its vertices. 

A set of points is convex if the line joining any 
two points of the set lies within the set. Convex sets 
have' no holes, in them, and their boundaries are straight 
or ben'd outward. The intersection of any two convex 
sets is itself a convex set. 
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In Figure 4 below, a, b and c are convex sets; d and 
e are not. 




Set a, consisting of a straight line and all the points 
on one side of it, is called a half-plane. Since the 
triangle — hb Figure ^ — Ls — forropH hv thp intersection of 
three such half-planes, it too is a convex set. The 
non-negative solutions to any linear programming problem, 
no # matter how complex,, lie in a convex set. 

2.3 Solving the Problem 

Now that we have a picture of all the points whose 
coordinates are possible solutions, we are ready to solve 
the^ problem, that is, to find the point whose coordinates 
minimize the cost, C, of the feed. To do this, we must 
interpret the equation of the objective function, C = 
6x + 8y, .as the equation of a line in the xy-plane. In 
slope-intercept form, this ^fuati l o> K ^ecomes 




v = 6x . C 

Thus, the slope of the objective function is -6/S, or 
-3/4, and the ^value of C determines the y-intercept, 
C/8. In particular, the smaller the value of C, the 
smaller the y- intercept w^lII be. 

All lines-with. slopes of -3/4 belong to a family of 
parallel lines, some of which are shown in Figure 5. 
These lines\can be viewed as possible positions of a 
single^line with a slope .of -3/4 moving across the coor- 
dinate system parallel to itself. In some of these 
positions it will pass through the region that, is shaded 
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Figure 5,.. The family of lines whose slopes are -3/4. 

t 

in Figure 3; in others it will not. Figure 6 shows 
Figure 5 superimposed on Figure 3. In Figure 6, the 
lowest line in the family to pass through the shaded 
region appears to be the one that passes through the 




point marked P. * Of all the'lines, that have slopes of 
-3/4 and contain at least one point that satisfies the 
constraints of the problem, this is the one with the 
smallest y-intercept. Point P is therefore the pofiit 
in the shaded region whose .coordinates minimize C. 

It can be shown that whenever a linear equation such 
as the objective function C = 6x + 8y is defined on* a 
.region ^bounded by a convex polygon, it will assume its 
minimum and maximum values at vertices of the polygon. 
To minimize or maximize the objective function of a, 
linear program, it 'is therefore necessary to evaluate it 
only at the vertices of the convex polygon determined by 
the constraints. The vertex that gives the best value 
of. the objective function is then the solution of the 
program. (In the special case where a side of the poly- 

_has the same sl ope as the objective function, two 
consecutive vertices and all the points Detwe 
minimize or maximize the function.) * 

Since the vertices of the convex polygon are points 
at which its sides intersect, the coordinates of these 
vertices can be found by solving the appropriate equa- 
tions simultaneously. Point P is the intersection of 
the protein and thiamine constraints; its coordinates 
are therefore found by solving simultaneously the 
equations 



2x + y 



and 



x * 5y = 30. 

In the same way, point Q i^ the simultaneous solution of 



2x + 



15 



\ 



and 



14x + 25y = 285 
and point R the simultaneous solution of j 
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x + 5y = 30 



and 



14x + 25y 



285. 



The coordinates of P, Q and R, together with the values 
of C they determine, are given in Table II below. 



TABLE II 



Coordinates of Vertex 

P (5, 5) 

Q (5/2, 10) 

R (15, 3) 



Value of Objective 
Function at Vertex 

C = 6(5) ♦ 8(5) = 70 

C = 6(5/2) ♦ 8(10) = 95 

C = 6(15) ♦ 8(3) = 114 



Table II shows that P is* indeed the vertex whose coor- 
dinates minimize the objective function. Thus, the 
chicken's weekly feed should contain 5 pounds of corn 
and 5 pounds of alfalfa, and the cost of this mix will 
be 70*. * ' 



r A - " ■ i i ii p rn fl vo in i n 

therefore necessary to: 

1. 
2. 
3. 
4. 
5. 



dimens ions . it is 




Formulate the constraints and the objective function 
Graph the constraints. 

Shade in the convex polygon they determine. 

Find the coordinates of the vertices of this polygon 

Evaluate the objective function at each of these ^ 

f # 
vertices. 

The vertex whose coordinates give ^the besir value of the 
objective function (a maximum or a minimum as the case 
may be) is the solution to the linear program. 



Exercise 4 . Solve the linear program for Exajnple 1, Section 2.1. 

Exercise 5 . Solve the linear program for Exercise 1. 

Exercise 6 . Solve the linear program for Exercise 2. _ 

Exercise 7 . Solve the linear program for Exercise 3. 
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3. CONCLUSION 



The problem with which this module began was a real 
problem, but the version of it given in Section 2.1 was 
greatly simplified. When the grain supplier actually 
made its chicken feed, it used nearly thirty different 
ingredients which, taken together, fulfilled the chicken's 
requirements for several dozen vitamins, minerals, and 
other nutrients. Correspondingly, the linear program 
which was formulated to solve the problem contained sev- 
eral dozen constraints, each involving up to thirty dif- 
ferent variables. 

Like this one, most real world problems in linear 
programming involve a large number of variables which are 
subject to many different constraints. Although similar 
in form to those for two variable problems, their li\iear 
programs are far more complex and are usually solved by 
computers. The method used for their solution, however, 
is ffiuirely analagous to the one presented here. 




no 

t V) 



\ 



4. SAMPLE EXAM 



Formulate and solve the following problems. 

1. The manager of a watch company is planning a month's 
production schedule. The company manufactures both 
quartz and regular watches and wishes to produce at 
least as many quartz watches as regular ones. An 
order for 225 regular watches has already been re- 
ceived, but no more than 500 regular watches are sold 
in any one month. Quartz watches require 3 hours of 
production time, regular ^watches 2. 3150 production 
hours are available, and there are 1150 sets of * 
' straps on hand and 870 quartz assemblies. If the 
company makes $15 on each quartz watch and $7 on each 
regular one, how many of each should it manufacture 
^ to maximize its profits? 



2: 



Dog food'*is made from a mixture of horsemeat and 
.beef.. The manufacturers want to use at least half 
as much horsemeat as beef and must use 75 pounds of 
beef already on hand. Each pound of beef contains 
1 gram of calcium, 5 grams of ash, and 1 gram of 
moisture. Each pound of horsemeat contains^ 1 gram 
am of ash, and 7 grams of moisture. 
The mixture must contain at least -225 grams or ci 
cium and may contain no more than 1100 grams of ash 
and 1580 grams of moisture. Tf beef costs $2 per 
-pound and horsemeat. costs $1 per pound, how many 
pounds of each should the manufacturers use to mini- 
mize their cost? 
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5. ANSWERS TO EXERCISES 



Exercise 1. 



Letting x = 

and y ~ 

< Maximize^ 
• f 

subject to 

where x > 0 

Exercise 2 . 

Letting x = 
and y = 
Minimize 
subject to 



the number of deluxe models to buy 
the number of standard models to buy 

OP = 3x + 2y \ 

x + y < 30 (number of machines) * 
2x + y < 44 (floor space) 
and y > 0. • 

i 

♦ 

the number of bus advertisements to be run 
the number of radio advertisements to be run 
, C = 3000x + lOOOy 

3x > y (ratio of bus ads to radio ads) 
' 400x + lOOy > 2100 



where x > 0 
Exercise 3. 



400x + HOOy > 9100 
500x + lOOy < 5000 
and y > 0. 



and y = 
Maximize 
subject to 



(uppdr income 
families) 

(middle income 
families) 

(lower income 
families) 



the num berof bushels of tomatoes to be raised 
the number of bushels of corn to 
P = 2x + 3y 
~«c " ~10x ~+ 60y < 30000 



5/100x + 5/200y < 30 
* x + y < 750 



(water) 
(acreage) 
(capital) 
x < 500 (limit on tomatoes) 
y < 475 ' (limit on com) 



where x ^ 0 and y > 0. 
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Exercise 4. 




Coordinates of Vertex 

A ( 0, 40) 

B (32, 24) 

C _ (40, 0) 



Value of Objective Function 
at Vertex| 

P = (.40) (0) + (.30) (40) = 12.-00 

P = (.40)(32) + {.30)(24)^ 20.00 



P * (.40) (40) + (.30) CO) |= 16.00 
B is the vertex whose coordinates maximize the dbjective func- 
tion. The bakery should make 32 eclairs and 24 napoleons. Its 
profit will then be $20.00. 



73 
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Exercise 5. 




10 15 20 • 25 x 



Coordinates of Vertex 

A ( 0, 30) 

B (14, 16) 

C (22, 0) 



Value of Objective Function 
at Vertex 

OP = (3)(0) + (2) (30) = 60 

OP = (3) (14) + (2) (16) = 74 

OP = (3) (22) + (2)(0) = 66 



B is the vertex whose coordinates maximize the objective 
function. The company should buy*14 deluxe machines and 
16 standard ones. Its output will then be 74 pieces per 
minute. 



80 
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Exercise 6 




10 20 30 x 



> Coordinates of Vertex 
(9, S) 
, 7)' 
"(3, 9)- 
(6. 25, IS. 75) 



Value oi Objective Function 
at Vertex 

C = (3000){9) + (1000) (5) 

= 32,000 
-X = (3000>{3.S) + (1000) (7) 

= 17,500 
C = (3000) (3) + (1000) (9) 

= 18,000 

C = (3€00)(6.25) + (1000)(18.7S) 
.=,37,500 



B is the vertex whose, coordinates minimize the objective func- 
tion. The producers' should run 3*s bus advertisements and 7 
radio advertisements every week. (Since they cannot run half 
an advertisement, this means that th*ey will run 7 bus adver- 
tisements every two wQeks.) The weekly cost of this campaign 
will be $17,500. 



Exercise 7. 



y = 475 



x + 6y = 3000 



400 




100 200 
Coordinates of Vertex 

A" (150, 475) 

B (300, 450) 

C (4S0, 300) 

D (500, 200) 



300 



400 



500 



600 



Value of Objective Function 
at Vertex 

-P = (2) (150) + (3) (475) = 1725 

P. = (2) (300) +<3) (450) = 1950 

P = (2) (450) + (3) (300) = 1800 

P = (2) (500) + (3) (200) =' 160O 



B is the vertex whose coordinates maximize* the objective 
function. .The farmer should raise 300 bushels of tomatoes 
and 450 bushels of com. His profit will then be $1950'. 

6. ANSWERS TO SAMPLE EXAM " . 

1. Letting x =*the number of quartz watches to be manufactured 
and y = the number of regular watches* to be manufactured* 
Maximize P = ISx + 7y 

subject to x > y , (ratio^of quartz to regular) 

225 1 y 1 500 $ (limits on regular) 

3x + 2y <_31S0 (production hours) 1 
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x * y < 1150 (straps) 

x < 870 (quartz assemblies) 

where x > 0 and y > 0. 




100 200 300 400 S00 - 600 700 s 800 .900 





Coordinates 


of Vertex 


Value of Objective Function- 










at Vertex 




A 


. (225, 


225) 


P = 


(15>(225) N ♦ (7) (225) = 


4950 


B 


(500, 


500) . \ 


';P = 


(1S)(S0Q) + (7) (500) = 


llOOCf 


C 


?650', 


500) 


P = 


(15) (650) + (7) (500) = 


13250 


D 


(850, 


300) 


P = 


(15) (850) + (7) (300) = 


14850 


E 


^ (870, 


270) 


P = 


(45) (870) + (7) (270) - 


14940 


F 


(870, 


225) 


P = 


(15) (870).+ (7) (225) = 


14625 



E is the vertex whose coordinates maximize the objective func- 
tion. The compan> should manufacture 870 quartz watches and 
270 regular watches. Its profit will then be $14,940. 

Letting x = the number of pounds of beef " to be used 

and y » the numbeT of pounds of horsemeat to be used 
Minimise C e 2x * y 

21 




- Coordinates j£f Vertex Va^ue of Objective Function 

- at Vertex 

A (150, 75) C = (2)C150) * 75 = 375 

B ( 7S, 150) , C = (2)( 75) + 150 - 300 

C (75, 215) ' C = (2)( 75) + 215 = 365 

D (180:. 200) C = (2) (180) + 200 = 560 

E (200, 100) C = (2) (200) ♦ -100 = 500 

% ■ 

*> 

B is the vertex rfhose coordinates- minimize the objective 
function. The manufacturers should \jse 75 pounds of beef 
$ and 150 pounls of horsemeat. 
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STUDENT FORM 1 
Request for Help 



Return to: 

EDC/UMAP 

55 Chapel St. 

Newton, MA 02160 
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Student : If you 'have trouble with a specific p^r s t.of this unit, please fill 
out this form and take it to your instructor for assistance. The' iaformation 
you give will help the author to revise t;he unit. 



Your Name 



v 



Unit No. 



Page_ 



O Upper 
OMiddle 
Q LQwer 



OR 



Section 



Paragraph_ 



OR 



Model Exam 
Problem No. 

Text 
Ptoblem No. 



Description of Difficulty: (Please be specific) . 



Instructor : Please indicate ybur resolution of^ the difficulty in this box. 
Corrected errors in materials. List corrections here: 



i 

O* ; 
Gave student better explanation, example, or procedure thai} in unit. 
Give brief outline of your addition here: 



( J Assisted stuc&nt in acquiring general learning and problem-seeing 
skills (not using Ipxamples f fru this unit*V^ 



q ©Instructor^' s Sigoature_ 

erJc ^ ^ ^- 



Please use reverse if necessary. 



Return to J 

STUDENT FORM 2 EDC/UMAP 



\, 



Unit Questionnaire 



Name \ lnit> No. Date 



Institution 



55 Chapel St. 
Newton, MA 02160 



Course No. 



Check the choice for each question that comes closest to your personal opinion. 

1. How useful was the amount of detail in the unit ? 

Not enough detail to understand the unit 
Unit would have been clearer with more detail 



^Appropriate amount of detail 

Unit was occasionally too detailed, but this was not. distracting 
Too much detail; I was" of ten distracted 



2. How helpful were the problem aniswers ?' ' >. 

Sample solutions were too brief; I could not do the intermediate steps 

Sufficient information was given 'to solve the problems 

Sample solutions were too detailed; I didn f t need them ( 



3. Except for fulfilling the prerequisites, how much did you use other sources (for 
example, instructor, friends, or c other books) in order to understand the unit? 

A Lot Somewhat A Little Not at all 



How long was this unit in comparison to the amount of time you generally spend on* 
a lesson (lecture and homework assignment) in a typical math or science course? 

Much Somewhat About Somewhat ' Much 
Longer * Longer the Same Shorter * Shorter 



5. Were any of the following .parts of the unit confusing or distracting? (Check 
as many as apply.) 

Prerequisites » • ^ 

Statement of skills and concepts (objectives) 

Paragraph headings 

_^ Examples _ ' 

" Special Assistance Supplement '(if present) 

Other / please explain ; ; 



6. Were any of the following parts' of the unit particularly helpful? (Check as many 
as apply . ) * 
Prerequisites 

Statement of skills and concepts (objectives) 

„ ^Examples 

P roblems* 

Paragraph headings . ' 



JTable of Contends 

"Special Assistance Supplement (if pi^sent) 
Other, please explain 



Please describe anything in the unit that, you did not particularly like. 



Please describeSanythiag "that you found particularly helpful. (Please use* the back of 
this sheet if you need more, space.) 
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} UNIT 453 - LINEAR PROGRAMMING IN TWO DIMENSIONS: I 



page 21: line segment CD in the graph should be labelled 

* ' x + y = 1150 
as illustrated below. 
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